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As a result of theycountervalllng pressures to both effectively 
respond to classroom disorder and yet protect student rights, principals, 
teachers, special educators, and school psychologists have become sen- 
sitive to the need for objectively documenting the basis for Interven- 
ttons. Whiu/evldence/jias accumulated that behavioral ratings are \ 
susceptlb;i:e to the biasing effects of pupil characteristics and prior / 
labeU<ig, other evidence can be found that direct observation and re- ' 
c^fdlng are not so Influenced. Presented here Is a procedure for sys- / i 
tematlcally observing and recording behavlotal difference; It has been 
used successfully by special educators over a period of five years to j 
document the existence of behavioral difference and td evaluate Inter- 
vention effectiveness. 
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A Direct Observation Approach to Measuring Classroom Behavior: 

Procedures and Application 

Virtually every teacher has at least one student who might variously 
be described as 'a behavior problem," "Inattentive," "hyperactive," 
"acting out," or "disruptive." The problems of managing social behavior 
in the classroom are so pervasive, in fact, that "lack of discipline" 
has been identified by the American public in eight of the last nine 
years (fiallup, 1978) as the major problem facing the schools. Disorderly 
classroom behavior is so comnon that it has become normal for a child to 
be Identified at least once as a behavior problem during the elementary 
school years (Rubin & Balow, 1978). 

At the same time, the i^ourts have acted clearly to establish the ' 
basic rights of students under the Constitution. Most recently, lawmakers 
have made It clear to educators that despite the ease with which they might 
identify children as socially deviant, they must not selectively segregate 
a child without ensuring that the child's rights to due process of law 
have been met ( Mills v. Board of Education , 1972). Further, if the school's 
recommendation is to make substantive revisions in the child's environment, 
those revisions must not only Include due process protections, but their 
effects must also be carefully monitored. As a result of the counter- 
vailing pressures to both effectively respond to classroom disorder and 
yet to protect the student's rights, principals, teachers, special edu- 
cators, and school psychologists have become sensitive to the need to 
objectively document the basis for interventions In children's lives. 
How, then, shall this be done? 



One approach has been to use behavior checklists dr rating scales 
completed by the classroom teacher or someone, who has ojbservcd the student 
In question* When such Instruments are used, however, 'the probability of 
bias Is significant (cf. Foster, Ysseldyke, & Reese, 1975; Ysseldyke 
& Foster, 1978). A preferable alternative seams to be the use of direct 
observation and recording of behavior which Is less susceptible to bias- 
ing (Madle, Nelsworth, & Kurtz^ 1979), and, consequently, better meets 
the requirement that behavioral difference be objectively documented. 

Since 1972, the author has been Involved In training teachers to 
intervene In their role p.s special education resource teachers. In their 
role as Intervention managers the teachers have learned to assess dif- 
ference In classroom behavior using a direct observation system developed 
In connection with a Special Project funded by the Bureau of Education 
for the Handicapped (USOE) . 

The observation system Is based on the assumption that any label 
applied to a child which Identifies that child as a conduct problem 
Implies that the child's behavior differs significantly from that of his 
or her peers. Proceeding from that assumption, we have used the obser- 
vation system to objectively determine the existence, and the extent, of 
that Implied behavioral difference. The remainder of this paper Is de- 
voted to describing the observation system used, to providing some data 
on Its validity, and to Illustrating Its use.^ 

The Observation System 
The recording procedures are only briefly described here to provide 
the reader with a general understanding of the observation system. A 
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more complete description is contained in a manual which may be obtained 
upon request from the author. 
What to Record 

The first concern in an observation and recording system is with 
what behaviors shall be observed and recorded. While in some approaches 
the decision regarding target behaviors must await the individual case, 
the position taken here is that a set of behaviors can be identified 
which fairly represents the categories of concern for most classroom 
teachers. The categories are "noise," "out. of place," "physical contact," 
and "off task." The number of categories is small so that the recorded 
behavior is likely to be high enough to warrant attention, and so that 
results are relatively easy to interpret by all concerned parties. 

Definitions . To develop consistency among observers, the following 
standard definitions of the categories of behavior are used: 

1. Noise is defined as any sounds created by the child which 
distract either another student (or students) or the 
teacher from the business at hand. The noise may be 
generated vocally (and includes "talk outs" or unintelli- 
gible sounds) or non-vocally (as "tapping a pencil" or 
"snapping fingers"). 

2. Out of place is defined as any movement beyond the either 
explicitly or implicitly defined boundaries in which the 
child is allowed movement. If the child is seated at his 
desk, then movement of any sort out of the seat is "out 
of place." If the chil^ is working with a group, then 
leaving the group is "out of place." 

3. Physical contact or destruction is defined as any contact 
w^th another person or another person's property which is 
unacceptable to that other person. Kicking, hitting, 
pushing, tearing, breaking, taking, are categorized as 
physical conta<*t or destruction. 

4. Off task Is defined as any movement off of a prescribed 
activity which does not fall into one of the three 
previously defined categorie s, "Looking around," "staring 

^\ into space," "doodling," or any observable movement off 
of the task at hand is included. 
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5. Other , While the behaviors defined above serve as a 

reasonable basis for most observations, Individual cases 
nay arise where other behaviors should be recorded* 
Children may be Ident^^fled who- do not communicate or who 
^ do not Interact. In such Instances either "self-lnltlated 

utterances" or "self- Initiated contacts" may be added, 
defined, and recorded. Generally, however, the first 
four categories will encompass many of the discrete 
categories which might be considered, and the "other" 
/ category should only be used If absolutely necessary to 

/ clarify the "problem" Identified by the teacher. 

Frequency Records 

The rationale for developing a system which focuses on what some 
would describe as exclusively negative behaviors should be given. 
First, to observe the reciprocal of each behavior (I.e., "quiet," "In 
place," "no physical contact," "on task") requires use of a recording 
system which describes no action on the part of the student. Record- 
ing procedures which describe no action, sdch as Interval recording, 
time sampling recording, or duration recording, generally require more 
observer training and technology than Is desirable If the system Is to 
be widely used. Second, to record the non-occurrence of behavior Is to 
describe what has been referred to elsewhere as "the statue" (White & 
Harlng, 1976) and to focus attention upon the student who will "sit 
St- , be quiet, and pay attention" — a value position which has been 
criticized elsewhere (Wlnett & Winkler, 1972). Finally, and perhaps 
most Importantly, the purpose of the recording system Is to aid In 
determining whether the frequency of the so called negative behaviors 
(which are, presumably, the basis for labeling the child with one of 
the common misconduct labels) Is, In fact, excessive. To not obtain a 
record of those behaviors would be a failure to directly measure the 
presumed basis for the label. 
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• lnterob8erver agreement . As Is true for any recording system, 
the definitions of the behaviors alone cannot be used as the. exclusive 
basis for ensuring consistency among observers; agreement ampng obser- 
vers Is a necessary condition for using the system. For that reason, 
any time observations are being made, on at least one occasion, two 
or more people observe and record the same behaviors at the same time. 
The consistency between these observations should then be determined 
by computing a coefficient of interobserver agreement. If two people 
cannot reasonably agree on how often something Is happening, then 
their disagreement should be resolved before further attempts to record 
the child's behavior are made. 

Proc edures. Figure 1 presents a recording sheet to be used when 
observing behavior. Each box represents an Interval of one minute. 
The first box in each row used for the target child's behavior represents 
the first minute during which that child's behavior is to be recorded. 
That is, dll of the behaviors to be record'ed for the target child are 
recorded simultaneously durinp the first minute. The recording method 
used has been variously referred to as "frequency," "event," or ' .ally" 
recording (cf. Hall, J 971: or Telfand & Hartnan, 1975)! Each time any 
one of tlic behaviors occurs during the first observation minute, the 
recorder continues to place tally marks In the first box for each occur- 
rence of the behavior until that minute has pressed. 



Insert Figure 1 about here 
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At the end of the first minute of recording,' the observer turns 
attention away from the target child to another child in the classroom. 
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or group. During this second minute of observation, the behavior of 
this child (called peer //I) is observed and recorded in the same manner 
as was just completed with the target child. Tally marks for peer #1 
are entered in the first boxes for the peer's behavior until the second 
minute of observation has been completed. The cycles of recording 
target child behavior for a minute and then another peer's behavior 
occur throughout the recording period. 

The peer sampling procedures described here were derived from, a 

coding system for observing classroom behavior developed by Cobb and 
Ray (1970). The system was modified subsequently and used by Patterson, 
Cobb, and Ray (1972) to contrast the behavior of a targeted student with 
that of his or her peers. More recently, Walker and Hops (1976) presented 
data on the use of normative peer sampling as a standard for evaluating 
treatment effects. They concluded that peer sampling is a useful pro- 
cedure not only in research, but also in evaluating intervention effects 
because it provided a framework for interpreting daily fluctuations in 
behavior and for estimating the level of behavior netessary to reinte- 
grate a student with peers. 

Within the perspective presented here, the primary purpose for 
observing peer behavior is to assess the basis for the teachers' des- 
criptions of the target child's behavior. The assessnent is accomplished 
by obtaining a precise measure of the relative difference between the fre- 
quency bf target child behavior on the one hand, and the frequency of 
peer behavior on the other. A comparison such as this is not useful 
unless two conditions are met: 



/ 

1* The peers constitute a group In which the target child 
is actually^xpected to hold membership (and, therefore, 
his or Jp(^ behavior in that group is relevant). 

2. Jhe peer behavior which is recorded is actually a 
"representative sample of the behavior of the total 
peer group. 

iHe first condition is usually met if the child is participating in a 
regular classroom in a conventionally organized school program. In 
these cases the classmates are the referen^ group. In school programs 
where groups shift frequently (as in modular scl^odules, ungraded programs « 
or open schools) more care must be taken to determin . the appropriate 
reference group. In all cases, the teacher who has Identified the child 
should be drawn into identifying the appropriate peer group for the 
target child since it is the teacher's expectations which are at the 
bipts of the initial referral. 

The second condition can be met only after the appropriate peer 
group has been identified, and is met by systematically obtaining repre- 
sentativeness . Prior to beginning recording, the observer should deter- 
mine the process by which the peers will be selected during the obser- 
vation. The process used should be one which eliminates the need for 
arbitrary decisions on the part of the observer since these momentary 
decisions are almost certain to be biased by unpredicted situational 
factors (e*g*, where the target child is sitting, or who happens to be 
making noise at the moment). It Is Important to point out In this con- 
text that the observer is not trying to assess the target child Vs be- 
havior relative to other children "most Hkc hltn or her" (i.e., one 
does not attempt to select offier children who are likely to "make a 
lot of noise" or be "out of place" a lot)* 
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S uTiimarlzlng results ♦ Once the data have been obtained it becomes 
Important to summarize results 'r* a form readily cnmprehenslble to 
teacher, parent, administrator, <ind child. No single summary procedure 
will always be satisfactory. The suimiary procedure recommended here, 
however. Is called the "discrepancy ratio." It Is the relative difference 
between the median level of the target child's behavior and the median 
level of the peers' behavior. The child who is off task four times per 
minute while his or her peers are off task two times per minute is a 
child who wot'ld be described as "off task two times (2X) more than his 
jT her peers." Illustrations of this approach to summarizing the dif- 
ference In the social behavior of ^ child and his or her peers are pre- 
sented in the data which follow. 

Validity and Utility of the Sysfeem 

Validity of measurement in behavioral recording is generally not 
an issue since the behavior to be observed is si^ecified by the person 
concerned with that behavior and measurement may involve simply tallying 
eac!) occurrence. Content validity is thereby ensured; concurrent, pre- 
- dlctive, and construct validity are not an issue since inferences beyond 
the data are not made. 

In the case of observational system8 which use standard behavior 
categories such as those presented here, however, the person concerned 
with the behavior (typically the teacher) has not selected or mpecffied 
the target behaviors. Further, the Inference may eventually be made 
that the target child Is, in some sense, socially deviant. To provide 
a modicum of data on the validity, and the sensitivity, of the observa- 
tion system described here a study was conducted to determine whether 
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students identified by their teachers as socially deviant did, in fact, 
behave differently from their peers when the present observation system 
was applied. 

Method I 



with an enrollment of approximately 550 pupils. The school is located 
intermediate to schools with the highest and lowest income families, and 
its minority enrollment at the time of the study was about ten percent. 

Observation sample . Eleven students were selected for observation 
by simply asking the teachers to "identify the child in your class who 
is having the most difficulty adjusting socially." The sample of target 
students included at least one child from every grade from K-6, with a 
sex distribution of six boys and five girls. Peers were selects^ed by the 
observer, using a systematic sampling strategy to avoid bias. Ten dif- 
ferent peers were observed on each observation. 

Procedure . Observations were conducted during periods of struc- 
tured academic work (I.e., Independent "seat work" during reading, math,, 
etc.). The observation periods ranged from 8:30 a.m. to 1:30 p.m. and 
each was twenty minutes long, providing ten minutes of data on a target 
child, and ten minutes of data on the peer sample. Five, not necessarily 
consecutive, days of observations were made for each target child an<f 
peer sample. 
Results 

The results for all observations are summarized In Table 1. 



The study was conducted 




school 



Insert Table 1 about here 
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As Table 1 illustrates, the greatest relative dliference between 
target students and their peers existed in the behavioral categories 
called "out of place" and "off task"; more target students differed by 
a factor of at least two on those categories. As might be expected 
in a structured academic period, "physical contact" or "destruction" 
occurred with the least frequency, A room-by-room analysis of the data 
revealed considerable variation in mean frequencies of the peer sample 
for a given behavioral category. Off task behavior, for example, ranged 
from a low of ,04 occurrences per minute in three rooms to ,11 occurrences 
per minute in a different three rooms. 

Analysis of individual target student data revealed that each stu- 
dent differed from his or her peers on at least one of the behavioral 
categories by a factor of two or more times, (That is to say, each stu- 
dent selected as "deviant" by the teachers performed at least one of 
the four behaviors twice as much as his or her peer sample.) Figures 
2, 3, and A present the individual data tor three different target stu- 
dents and their respective peer samples. 

Insert Figures 2, 3, and A about here 

The individual data are presented to illustrate the different con- 
figurations which the observation system might reveal and the variability 
in day-to-day behavior charat eristic of both target students and peers. 
As may be seen, an observed difference in median frequency of occurrence 
between the target child and the peer sample was obtained for Pa and Pe 
on the category called "out of place," but not obtained for ija. A dif- 
ference was obtained in "off task" for Pa and Ma, but not for Pe. In 
Pe*8 case, however, the subject was less noisy than the subject's peers. 
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None of the three target students differed in median frequency of pc- ' 
currence for the category "physical contact"; however, a difference would 
clearly be obtained fdr Ma If mean rather than median frequency of occur- 
rence was used as the measure of central tendency. It Is worth further 
mention that the median difference obtained for "physical contact/destruc- 
tion" between target students and peers was smaller than the median dif- 
ferences obtained among the classrooms. The students In Ma's class 
apparently were more likely to emit behavior coded as physical contact/ 
destruction. Such variation In the levels of behavior among classrooms 
underscores the Importance of sampling peer behavior as well as that of 
a targeted student. 

An additional point to be made regarding the Individual data bears 
on the value of multiple behavior samples when assessments are made. 
It Ma had been observed only on day 2 of the observation sessions, one 
would have erroneously concluded that the subject differed from the peers 
only In terms of off task behavior. The subject's behavior on the three 
other categories was either equal to or less than that of the peers. 
However, that Inference la contradicted In the data from multiple samples. 
Similar contradictions- may be found In each of the other cases. The 
conclusion Is clear. When attempting to document behavioral difference 
through classroom observations, multiple observations ar'e essentia] If 
erroneous conclusions are to be avoided. 
Utility 

The usefulness of any classroom observation system similar to the 
one presented here Is finally determined by attempting to apply It to 
the solution of Individual problemE. In this closing section of the paper 

I 
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an example is presented of how the system is used to establish the need, 
for, and to evaluate the effects of, a social behavior Intervention. 
Use of the observation system and development of the Intervention were 
accomplished by a special education resource teacher as a part of that 
teacher^s Job responsibilities* 

The problem t Marilyn was eight years old and In a second grade 
classroom. Her teacher, Mrs. Nelson, referred Marilyn to special s^prvlces 
because ''she was always out of her seat bothering other students and 
seldom completed her morning seat work during morning reading Instruction/' 
Marilyn's mother was contacted by the principal to determine whether she 
felt a problem existed; she told him: "I do not call you when a problem^ 
occurs at home, and I would appreciate It If you did not bother me at work 
with school problems." When Marilyn was Interviewed to assess her view 
of the situation, she stated she did not like th^ school, the work, or 
Mrs. Nelson who she believed disliked her. Further, she claimed to have 
no friends In the room. 

The assessment . Marilyn was observed in class for five days using 
the observation system previously described. Her behavior was observed 
to be 1.5 times greater in the "off task" category, and 1.7 times 
greater in the "out of place" category (see Figures 5 and 6). 

Insert Figures 5 and 6 about here 

The intervention . Once the resource teacher summarized the data 
he concluded that while Marilyn's behavior was apparently different 

from that of her peers; th^ data also showed that the entire class was 

2 

emitting both categories of behavior at a high rate. The resource 
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teacher showed Mrs. Nelson the data and she responded by saying that 
this particular group of children had been especially hard to manage 
and that It had been a difficult year. She said, further, that when 
Marilyn had entered the class two months previously, she was Just one 
roore problem child. She finally concluded that "maybe the whole class 
needs some control." 

Together, Mrs. Nelson and the resource teacher developed a simple 
plan to Influence both Marilyn and her classmates. Briefly, the man- 
agement system consisted simply of haVlng the students earn the right to 
a play time by completing seat work assignments without leaving their 
seats or talking loudly. Each occurrence of either leaving the seat 
or loud talking resulted In a two-mlnuCe reduction In play time. 

The results . To assess the effectiveness of the Intervention, 
the resource teacher continued to observe the behavior of Marilyn and / 
her peers. The results of the Intervention on the behavior of both / 
Marilyn and her peers are revealed In the' data displayed graphically 
In Figures 5 and 6. As can be seen, the effects with respect to "out 
of place" behavior were marked for both Marilyn and her peers. The 
median frequencies for both during the second week amount to. approximately 
one occurrence during the observation period. No such clear effect can 
be seen for "off task" behavior. A small reduction appeared to occur In 
Marilyn's off task behavior but no clear change occurred for the peers. 
At this point some revision might have been made In the program to Influ- 
ence off task behavior; however, the sch:>ol year was ending and no 
further revisions were made. 

The case study well Illustrates the potential use of the observation 
system. Other teachers have used the system similarly, and some have made 

1 • 
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more extensive use of the "other" behavior category to obtain data on 
behaviors not specifically defined* The case presented here was selected 
because It underscores the Importance of assessing a child* s behavior 
relative to the child's peers. Wer<» the resource teacher to have assumed 
that Marilyn •'s behavior was the primary problem and have observed only 
Marilyn's behavior, the Intervention subsequently developed with Mrs. 
Nelson might have been far different — focusing exclusively on Marilyn 
rather than the entire class. The data obtained during initial assesbTient 
provided a clear basis In fact for the discussion between Mrs. Nelson and 
the resource teacher which led to a change in the teacher's behavior, 
which, hopefully, was fairer to Marilyn and benefited everyone Involved. 
Final Notes 

The data obtained through using the system described here can be 
summarized and presented in a variety of ways. How the d *ta are summar- 
ized is, of course, less Important than how they are Interpreted. Great 
care should be taken to use the data fairly for all persons Involved. 
That means that once differences In behavior are empirically established, 
the Importance of those differences in each Individual case must be 
addressed by all parties with a vested Interest in that difference (i.e., 
student, parents, teachers, etc.). To quote Robert Mager (1970) on this 
point, "If a discrepancy can be Ignored it should be." A person who 
is out of his or her "place" more Is not Ipso facto behaving wrongly. 
A careful examination should be made at the same time of the extent to 
which the expectations for behavior are reasonable and appropriate. 
Within the petspective presented here, if we can eliminate the differ- 
ence between the level of b'.'havior which Is desired by someone, and the 



level of behavior actually emitted by the student, "the problem" has 
been eliminated. The most economical solution, then, is to set aside 
the desired or expected performance level and accept the perfosmance 
actually emitted. Unfortunately, such "setting aside" Is not usually 
the easiest solution for whomever holds that expectation for behavior. 
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Footnotes 

^Although the system described here Is directed toward classroom 
social behavior, the procedures are generallzable and can be used anytl 
one wishes to obtain a measure of the discrepancy between two sets of 
behavior, whether those behaviors are academic or social, and whether 
they occur inside or outside of school settings • 

This conclusion can be placed in perspective by referring to the 
peer rates of these behaviors presented earlier in this paper. 
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Tablft 1 

Mean Frequencies of Behaviors for Target Students and 
Peer Samples, and Number of Target Students Exhibiting 
Two or More Times the Peer Frequency for Each Category 



Mean Frequency (per minute) 



Behavior 



Number of Target Students 



Target Students Peer Samples Two or More Times Discrepant 



Out of Place 
Off Task 
Noise 

Physical Contact 



.15 

.25 
.03 



.04 
.11 
.17 
.02 



9 
9 
4 
3 
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Figure 1 
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